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Abstract 



The Erdos-Szekeres theorem states that, for every k, there is a number rifc such that every set of 
Tifc points in general position in the plane contains a subset of k points in convex position. If we 
ask the same question for subsets whose convex hull does not contain any other point from the 
set, this is not true: as shown by Horton, there are sets of arbitrary size that do not contain an 
empty 7-gon. 

These questions have also been studied extensively from a computational point of view, and 
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polynomial time algorithms for finding the largest (empty) convex set have been given for the 
planar case. In higher dimension, it was not known how to compute such a set efficiently. 
r~i In this paper, we show that already in dimension 3 no polynomial time algorithm exists for 

\«/ determining the largest (empty) convex set (unless P=NP), by proving that the corresponding 

decision problem is NP-hard. This answers a question by Dobkin, Edelsbrunner and Overmars 
^ from 1990. 

I ^ I As a corollary, we derive a similar result for the closely related problem of testing weak e-nets 

in K^. Answering a question by Chazelle et al. from 1995, our reduction shows that the problem 

^ is co-NP-hard. 
> 

On ^ 

^ 1 Preliminaries 

in ^ 

• The Erdos-Szekeres theorem |8] is one of the major theorems from combinatorial geometry 

, and one of the earliest results in geometric Ramsey theory. 



> 
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► Theorem. (Erdos and Szekeres, 1935) For every k there is a number such that every 
planar set of Uk points in general position contains k points in convex position. 

Exact values of n^. arc known only for very few cases and subject to extensive research, also 
for the higher dimensional cases. 

A closely related question is the following: is the theorem still true if we ask for sets 
whose convex hull is empty, i.e., does not contain any other point from the set? That this 
is not the case was shown by Horton [TT]: in the plane there are arbitrary large sets which 
do not contain empty 7-gons. Nicolas [H] and Gerken [S] independently solved the long 
standing open problem whether or not there is always an empty 6-gon. 

Both these questions generalize to dimension larger than 2 in the obvious way, and clearly 
the numbers rik do not increase when the dimension gets larger (proof: project to M^). See 
the surveys by Barany and Karolyi [5] or Morris and Soltan [T3] for further references and 
(more or less) recent progress on the subject. 
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The corresponding computational problems have also received a lot of attention in the 
past (e.g., [T], [5], [7], [H]). Polynomial time algorithms are known for both problems in the 
plane. The fastest algorithm is given in , and the question is stated whether a polynomial 
time algorithm for determining the largest empty convex set also exists in M^. 

1.1 Our results 

In this paper, we will consider the following decision problems: 

► Definition 1. (Erdos-Szekeres) Let P be a set of points in and k e N. Is there a 
set Q (- P oi k points in convex position? 

and 

► Definition 2. (Largest-Empty-Convex-Set) Let P be a set of points in M"^ and k eN. 

Is there a set Q <Z P oi k points in convex position whose convex hull does not contain any 
other point from P? 

Using the reduction technique from Giannopoulos et al. [lOj . it is a mere exercise to 
show that both problems are NP-hard if the dimension is not fixed. For people familiar with 
parameterized complexity: the problem is even W[l]-hard with respect to the dimension d. 
This means that it is very unlikely to admit an algorithm with running time O {f{d)n'^) for 
any computable function / and constant c. 

Still, this does not exclude the possibility that in every fixed dimension, the problem can 
be solved with a running time of, say, 0(n'^'^^). In this paper, we show that this cannot be 
the case (under standard complexity theoretic assumptions): 

► Theorem 3. The problems Largest-Empty-Convex-Set and Erdos-Szekeres are 
NP-hard in M^. 

The first part of the theorem, hardness of LEGS, is shown in Sec. |2] In Sec. |3] the 
proof is adapted to ES. In Sec. [4] we derive a similar result for testing weak e-nets and 
red-blue discrepancy. Finally, in Sec. [S] we make several suggestions for further research on 
the subject. 

2 The reduction 

We will show that the problems is NP-hard by a reduction from the following problem: 

► Definition 4. (Independent-Set-for-Nonoverlapping-Unit-Disks) Given a set of 
pairwise non-overlapping unit disks in , decide whether there are k disks such that no two 
of them touch. 

Here, non-overlapping means that the interiors of the disks are pairwise disjoint. As shown 
by Gerioli et al. [3 , the problem ISNUD is NP-hard. We will now reduce this problem to 
LEGS and show how to adapt it to ES in the next section. 

For a given instance V of unit disks in the plane, we will create a set of points in E'^. 
These points will almost lie on the elliptic paraboloid, in a sense to be made precise later. 

For a point x = (si, X2) G E^, let 

lift : (a;i, X2) — > {xi,X2,x\ + x\) 



denote the standard lifting transform to the paraboloid. 



Let Dc denote the n centers of the disks in V. Let L denote the set of all points x = lift(a;), 
for X S Dc- 

We now want to forbid certain pairs of points to lie in empty convex positions, namely 
those for which the corresponding disks intersect. Thus, for a pair of intersecting disks d, d! 
and their centers q, Cd> , we add a blocking point 

bdd' = ^(lift(cdO + lift(cd)). 

The set B then consist of all the points {hdd' \ dC\d' ^ 0}, and we set P = L\+S B. 

Thus, we have created 0(|I?|) points and the reduction is linear in the input size. The 
main property of the reduction is captured in the folowing lemma. 

► Proposition 1. Let Q be a set of points and ft, be a hyperplane such that hx > for all 
X (z Q. Then a point x is in ch(Q) if and only if it is in ch(Q D h). 

► Lemma 5. A blocking point bdd' is contained in the convex hull of a set Q Q L if and 
only if Cd and Cd' are contained in Q. 

Proof. <^=: by definition 

=J>: We show that there is a hyperplane that contains bdd', Cd, and Cd' and has all other 
points strictly on the positive side. Here we will make use of the fact that our instance 
consists of non-overlapping unit disks - otherwise, the claim would not hold. 

Let C be the circle with center proj {bdd' ) through Cd and Cd' ■ Because all disks are non- 
overlapping unit disks, this circle does not contain any other points from Dc- We then take 
as h the unique hyperplane whose intersection with the paraboloid projects to the circle C . 
This hyperplane contains all three points, and because the C did not contain any points 
from Dc, all other points from L and thus B lie strictly above h. The claim then follows 
from Proposition [T] A 

The following states that whether or not a set is in empty convex position will depend only 
on which points we choose from L. The set B can always be added without destroying this 
property. 

► Proposition 2. The sets L and B each are in empty convex position, and ch(L) — ch(LUB). 

Proof. By construction, all points of L lie on the paraboloid. The points from B can be 
separated from each other by the hyperplane defined in the previous proof. As all of them 
are convex combinations of points in L, we have ch(i?) C ch(i). 

► Corollary 6. A set S — L' \iiQ' P is in convex position if and only if no point of Q' C Q 
is contained in the convex hull of L' C L. 

The main lemma then reads as follows: 

► Lemma 7. There is an independent set of size m among the unit disks if and only if there 
are m + \B\ points in empty convex position. 

Proof. Let /, |/| = m, be an independent set among the set of disks. Let I C L denote 
the corresponding lifted centers. We claim that S = I U B is in empty convex position. 
Indeed, by Observation [2] no point of L — J is in the convex hull of S. Further, by Lemma 
[5] if some point b E B was in ch(S'), this would mean that there are two points in / that 
contained b. Thus, the corresponding disks would touch, and / would not be an independent 
set. This means that there are to -I- |_B| points in empty convex position. 
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<^=: Now assume that there is no independent set of size m. This means that for any choice 
of m disks, two of them touch. Now take any set 5 of to + \B\ points. As there are only 
\L\ + \B\ points in total, this must contain at least to points from L. Thus, some two of 
them belong to disks that intersect. By Lemma |5] their convex hull contains a point of B. 
Thus, S is not in empty convex position. M 

'^3 Adaption to Erdos-Szekeres 

We now show how this reduction can be applied to Erdos-Szekeres. One direction of 
Lemma [7] is clear, since we have shown how an independent set of size to results in an empty 
convex set of size to+ \B\. For the other direction, we need to show that if there is any not 
necessarily empty convex set of to+ \B\ points, then there is also an independent set of size 
TO among the disks. 

► Lemma 8. There is an independent set of size m among the unit disks if and only if there 
are m+ \B\ points in convex position. 

Proof. An empty convex set is convex. 

<;=: Let S* be a set of to + \B\ points in convex position with |S' n i?| < \B\. We show how 
to construct a set S' in convex position of the same size such that |S"ni?| = |5'ni?| + l. 

Let / — SnL, and let Dj be the corresponding set of disks. Observe that, if |S'ni?| < \B\, 
then |/| > TO. If all disks from Dj are independent, we are done. Otherwise, let d and d' be 
two disks from Dj that intersect. The point bdd' cannot be part of S, for otherwise S would 
not be in convex position. If we thus set S' = I — {d} U BU {bdd'}, the set is still in convex 
position and we have \S'\ = \S\ and \S' H B\ > \S Ci B\. Thus, after finitely many steps we 
end up with a set of to + \B\ points which contains all points from B. In particular, the set 
contains no point from B in the convex hull. But this means that the disks corresponding 
to these m points from L do not intersect. Thus, we have an independent set of size to. 

This finishes the proof of Thm. [3] 

4 Testing weak er-nets and red-blue discrepancy 

Here we shortly mention that the hardness proofs also show hardness for two closely related 
problems. Recall that a range space is a pair {X, TZ), where TZ C 2-^ . If X is a set of points 
in M'' and TZ is the set of all convex sets determined by them, a weak e-net for {X, TZ) is a 
set of points S such that \S n R\ ^ whenever \RnX\ > e\X\, for all R e TZ. We then 
define the corresponding decision problem as follows: 

► Definition 9. (e-Net- Verification) Given a set of points P c M.'\ another set c M*^ 
and an e > 0. Is an e-net for P with respect to all convex sets? 

Chazelle et al. [Ij give a polynomial time algorithm for the problem in the plane and ask 
whether it is solvable in polynomial time in M.^. 

A closely related concept is that of red-blue discrepancy: Given a set R of red and a set 
B of blue points, the discrepancy of a set C is defined as D{C) — \ \RnC\ — jS n C||. The 
discrepancy of the set P = RUB is then defined as D{P) ~ maxc D{C). The corresponding 
decision problem Red-Blue-Discrepancy asks whether the discrepancy of a given set is 
at least some value fc s N. 



Now observe that the set of blocking points B determines an (rn/n)-net^ for the set of 
lifted points L if and only if there is no independent set of size m among the disks. A similar 
argument holds for Red-Blue-Discrepancy. Our proof then also shows the following: 

► Theorem 10. The problem e-Net-Verification is co-NP-complete in and Red- 
Blue-Discrepancy is NP-hard in R^. 

5 Conclusion and open problems 

This is work in progress (even though very little progress has been made in the past few 
weeks). In the future, we will try to extend the paper in the following direction. 

The major open question is how to find an approximation algorithm for the problems 
Erdos-Szekeres and Largest-Empty-Convex-Set. The obvious approach (projecting 
to and solving the problem there) does not work very well: as shown by Chazelle et al. 
[S], there are polytopes whose projection in any direction has 0(log n) vertices on the convex 
hull. While this leads to a polynomial time (log n) /n-approximation, only very few people 
will find this satisfying. Thus, the question for a more intelligent (probably constant-factor) 
approximation algorithm remains and seems to be very challenging. 

In addition to this, the most interesting question is maybe the following: Is Largest- 
Empty-Convex-Set in R^ fixed parameter tractable with respect to the size of the so- 
lution? That is, can we decide whether there are k points in empty convex position in 
time O {f{k) ■ n'^) for some computable function / and constant c? More generally, given 
a point set P in M'', can we decide whether there is an empty convex set of size k in time 
0(/(fc)nOW)? 

Observe that due to the Erdos-Szekeres theorem itself, the problem Erdos-Szekeres 
is trivially fixed-parameter tractable: Given a point set P and a fc g N, if n := |P| < 2^ , 
we use a brute force algorithm, i.e., simply try all subsets of size k. This takes time (^) « 

< (2*^)*^. If n > 2*^, we simply answer yes. In any case, the running time is bounded by 
2*^ , and thus we have an algorithm with running time O {f{k)n). Still, the question for a 
polynomial size problem kernel remains. 
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